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Spin liquids occuring in 2D frustrated spin systems were initially assumed to appear at strongest 
frustration, but evidence grows that they more likely intervene at transitions between two different 
types of order. To identify if this is more general, we here analyze a generalization of the spa- 
tially anisotropic triangular lattice (SATL) with antiferromagnetic XY interactions, the spatially 
completely anisotropic triangular lattice (SCATL). This model can be implemented in experiments 
with trapped ions, ultra-small Josephson junctions, or ultracold atoms in optical lattices. Using 
Takahashi's modified spin-wave theory, we find indications that indeed two different kinds of order 
are always separated by phases without magnetic long-range order. Our results further suggest 
that two gapped, magnetically-disordered phases, identified as distinct in the SATL, are actually 
continuously connected via the additional anisotropy of the SCATL. As these results indicate, this 
additional anisotropy - allowing to approach quantum-disordered phases from different angles - can 
give fundamental insight into the nature of quantum disordered phases. We complement our results 
by exact diagonalizations, which also indicate that in part of the gapped non-magnetic phase, chiral 
long-range correlations could survive. 

PACS numbers: 75.10.Jm, 03.75.Lm, 75.10.Kt, 75.30.Ds 



I. INTRODUCTION 

In recent years, the implementation of strongly- 
correlated lattice boson models in optical-lattice exper- 
iments has seen tremendous advances (see, e.g., pQ and 
references therein) . Particularly appealing in this respect 
are models with frustration, arising for instance from the 
coupling of the bosons to an artificial magnetic field 
or from a periodical shaking of the optical lattice [7HTT]. 
Frustration in the intersite hopping is formally equiva- 
lent to a description of the system in a rotating refer- 
ence frame, which implies that the system is subject to 
the spontaneous appearance of vortices. Such vortices 
can form ordered arrays (vortex crystals) coexisting with 
Bose condensation, which consequently takes place in a 
macroscopic wavefunction sustaining persisting circulat- 
ing currents (see Ref. [12] and references therein); or they 
can even disrupt condensation completely, and lead to a 
disordered insulating state [13]. Such disordered states 
are notoriously difficult to study theoretically. 

In the limit of strong on-site repulsion, such bosonic 
models can be exactly mapped to S = 1/2 XY antifer- 
romagnets |14| . In two dimensions, such frustrated XY 
models exhibit ground states with spiral order, repre- 
senting the magnetic counterpart to the aforementioned 
Bose-condensed states with vortex arrays. More strik- 
ingly, the interplay between quantum fluctuations and 
frustration may lead to disordered spin-liquid states, 
which are in one-to-one correspondence with bosonic in- 
sulating phases. While our main motivation stems from 
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the recent advances in ultracold atoms in optical lattices, 
antiferromagnetic (AFM) XY models are relevant to a 
number of systems: they can be regarded as the limiting 
case of AFM Hamiltonians with planar anisotropy in the 
couplings, which describe frustrated AFM materials, and 
they govern the physics of planarly trapped ions loaded 
into an optical lattice [15J or Cooper pairs in arrays of 
ultra-small Josephson junctions [T6] , 

Planar systems of bosons in optical lattices can be de- 
scribed by the Bose-Hubbard Hamiltonian 

%H=Ey (b\bj + hx.) +^J2 n i( n i~ !) (!) 

where ^, b\ are bosonic operators, rii = b\bi, and 
represents pairs of nearest-neighbor (NN) sites. We 
consider AFM hopping amplitudes, with positive sign, 
Uj = \tij\, which for atoms in optical lattices can be 
achieved either by coupling to an artificial magnetic field 
[2]-[6] or by lattice shaking [7HTT]. In the following, we 
will focus on the limit of infinite repulsion U — >• oo and 
half filling (m) = 1/2, under which the Bose-Hubbard 
model maps to the S =1/2 XY Hamiltonian 

ns = y Zu j (s?s? + s?sy) (2) 

(hj) 

where are spin- 1/2 operators acting on site i. 

Recently, periodical driving of an optical lattice has 
allowed to experimentally realize a particular paradig- 
matic frustrated spin model, the spatially anisotropic tri- 
angular lattice (SATL) |8J. As described in Ref. [7], the 
bare tunneling matrix elements — \Uj\, connecting ver- 
tices of a triangular lattice such as depicted in Fig. [T] are 
dressed by the periodic driving with the factor ((e mij )). 
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Figure 1: Geometry of the SCATL. The spins (gray bul- 
lets) are coupled to nearest-neighbors along the lattice vectors 



Ti,2,3 by the couplings t Tl = t, t T2 = and t r 



which 



can all be mutually different. The right part of the Figure 
shows the associated square lattice. The shown geometry is 
the one used in the ED of the 15-site system, chosen for max- 
imal symmetry between all three couplings. 



Here, the double brackets denote time averaging and 
dij = A • Vij/h is the projection of the periodic driv- 
ing orbit, A, on the vector connecting sites i and 
j. For brevity, we suppressed the explicit time depen- 
dence in dij and A. In Ref. [8 J, this has been used to 
realize the AFM SATL by flipping the sign of the bare 



tunneling (— ^ 



U 



thus creating AFM interac- 



tions leading to geometrical frustration. Further, the pe- 
riodic driving orbit has been chosen such that the tun- 
nelings along the diagonals are equal, i.e., t' = t" with t' 
along r 2 = (1/2, V3/2) and t" along r 3 = (-1/2, >/3/2), 
and different from the third, horizontal one [£, along 
T\ = (1,0)]. The experiment of Ref. [8] was at weak 
U, which corresponds to the classical limit, but expec- 
tations are high that soon also the regime of strong re- 
pulsion U — >• oo may be reached. Here, the XY SATL 
is particularly interesting, because of predictions for sev- 
eral non-magnetic phases without classical counterpart 

nana. 

Another implementation of the XY SATL within reach 
of current technology are trapped- ion setups |15| . Here, 
the bosonic particles governed by Eq. Q are provided by 
the vibrational modes of the ion crystal. The tunneling 
matrix elements Uj can be tuned via the preferred direc- 
tion of vibration of the ions, and superposing an optical 
lattice allows to create strong on-site repulsion U. Proof- 
of-principle experiments using trapped ions to simulate 
spin models without HH [19] and also with frustration 
[20J let it seem realistic that in the near future the SATL 
with a mesoscopic number of sites can be implemented. 

Motivated by these developments, we consider in this 
work a generalization of the SATL, the spatially com- 
pletely anisotropic triangular lattice (SCATL), where all 
three tunneling matrix elements are different. Ultracold- 
atom experiments as Ref. [8] and trapped-ions implemen- 
tations after the proposal [15J can easily be generalized 
to this situation by choosing an elliptical driving orbit or 
a preferred direction of ion vibration, respectively, which 
is not parallel to any of the sides of the triangular plaque- 



ttes. The geometry is depicted in Fig. [T] where we also 
sketch the associated square lattice with an interaction 
along one of the diagonals. We will work in the latter, to 
simplify the interpretation of our results. 

The SCATL is interesting for two reasons. First, 
from a practical point of view, it is relevant for study- 
ing the sensitivity of the predicted non-magnetic phases 
to imperfect driving, i.e., driving which does not cre- 
ate two perfectly equal couplings. Second, from a more 
fundamental point of view, this model allows to inves- 
tigate in a more general setting under which circum- 
stances quantum-disordered phases appear. Namely, 
in the SATL, it was found that - similarly to the 
same model with Heisenberg interactions - non-magnetic 
ground states do not occur at largest frustration but in- 
stead intervene in the transition between phases with dif- 
ferent type of order, which are therefore never directly 
connected. This leads also to the particularly impor- 
tant possibility that the spiral phase (occurring in the 
SATL near the isotropic point t = t' = t") is completely 
surrounded by gapped quantum-disordered phases. This 
would mean that the two, supposedly different, gapped 
non-magnetic phases appearing in the SATL are actually 
continuously connected! Such a finding would yield deep 
insight into the nature of the quantum-disordered regions 
in the SATL. 

To address these issues, we investigate in this work the 
5 = 1/2 SCATL with AFM XY-interactions, Eq. 
within Takahashi's modified spin-wave theory (MSWT) 
|21j . supplemented with ordering- vector optimization. 
As shown previously [17, 22J, this improves significantly 
over conventional spin-wave theory (as well as over con- 
ventional MSWT), as it allows to account for the dra- 
matic quantum corrections to the type of order appear- 
ing in frustrated quantum antiferromagnets. Further, the 
breakdown of the theory provides a strong signal that the 
true ground state might be quantum disordered; hence, 
this method serves to efficiently find candidate models for 
spin-liquid behavior. While the main focus of this article 
is on the MSWT results, we complement them with ex- 
act diagonalization (ED) of small clusters. The 5 = 1/2 
AFM SCATL with Heisenberg interactions, motivated by 
experiments on magnetic organic salts, has been treated 
in a similar way in the preceding article [23]. 

The rest of this paper is organized as follows. First, 
to form intuition about the quant um SCATL, we dis- 
cuss its classical counterpart (Sec. |I A| ), and review im- 
portant res ults from its well-studied limiting case, the 
SATL (Sec. [LB]). Sec. [il] contains our main results, namely 
the discussion of the quantum-mechanical ground-state 
phase diagram of the SCATL, including various observ- 
ables from MSWT and ED, as well as, for a possible 
comparison to experiment, the expected boson momen- 
tum distributions at selected points of the phase diagram. 
We delegate the technical details of the MSWT to the 
Appendix. Sec. |III[ finally, provides some conclusions. 
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Figure 2: Classical phase diagram of the SCATL: The 
ordering vector evidences three Neel-ordered phases, an ex- 
tended spiral-ordered phase, and limits where the system de- 
couples into an ensemble of independent chains, as indicated 
by the labels in the left panel. The thick red lines denote tran- 
sitions between different kinds of order, and along the dashed 
black lines the system is in SATL limit. 



A. Classical phase diagram 

In this section, we discuss the classical phase diagram 
of the SCATL, which can serve as a guide to what ordered 
phases are to be expected, and which allows to appreciate 
the changes brought about by quantum fluctuations. 

To obtain the classical solution, we replace the 
quantum- XY spins in Eq. Q by classical rotors in 
the xy-pl&ne. The ordering vector Q cl = (QxiQf) 
is found as the fc-vector which minimizes the Fourier 
transform of the coupling strengths. It fixes the di- 
rection of each spin (up to a global phase) as Si = 
S (cos(Q cl • r i ),sin(Q cl • n)). We find 
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The classical phase diagram of the SCATL, plotted 
in Fig. [2j contains several Neel-ordered phases and an 
extended spiral-ordered phase. The Neel phases spread 
around the square-lattice limits [(t r /t,t" jt) = (1,0) with 
Q cl = (0,tt), [(t'/t,t"/t) = (0,1) with Q cl = (tt,0), and 
t' /t,t" jt > 1 with Q cl = (7r,7r)]. The spiral phase, with 
continuously varying ordering vector, connects smoothly 
to the Neel phases, and occupies the extended region 
between them. In particular, it extends all the way 
to t'/t = t" /t = [and, symmetrically, to (t'/t = 1, 
t" /t — » oo) and (t" jt = 1, t' jt — »• oo)], where the system 
decouples into an ensemble of ID chains. 



B. Known results in limiting cases 

In this section, we discuss well-known limiting cases 
of the quantum SCATL, including results on the SATL. 
This helps us to assess which phases and quantum effects 
to expected in the phase diagram of the SCATL. 

The SCATL interpolates between several important 
limiting cases. For (t'/t,t"/t) = (1,0), (t* /t,t" /t) = 
(0,1), and t' /t,t" /t ^> 1, one recovers the square lat- 
tice limit. Here, Neel long-range order (LRO) persists in 
the quantum case [53]. Similarly, in the isotropic trian- 
gular lattice, t' = t" = t, spiral LRO survives quantum 
fluctuations [25]. The limits (t 1 = t" = 0), (t f oo 
with t" = const), and (t" — > oo with t' = const) cor- 
respond to ensembles of decoupled, critical XY-chains, 
with algebraic correlations along individual chains but 
no correlations between them. 

For t' = t" = at (or, equivalently, t 1 = t or t" = t\ 
one recovers the SATL, where projected entangled-pair 
states (PEPS) calculations [15] and MSWT (as well as 
ED) [17J suggest the existence of several non-magnetic 
phases. In the rest of this section, we briefly review the 
main features of the SATL phase diagram, proceeding 
from large to small a = t'/t (for comparison, Fig. [^re- 
produces the MSWT phase diagram found in Ref. [17J). 
The qualitative behavior is very similar to the SATL with 
Heisenberg interactions (for a short review, see preceding 
publication |23j), but the decreased symmetry in the XY 
case mitigates the effects of quantum fluctuation. 

At large a, order- by-disorder effects due to quantum 
fluctuations stabilize Neel order considerably, moving the 
point where it disappears downwards from the classical 
value a — 2 to values between a w 1.4 (PEPS, Ref. [15J) 
and a w 1.66 (MSWT, Ref. [17J). These methods predict 
that quantum fluctuations spread the transition point 
between the Neel and the spiral phase into a quantum- 
disordered phase. In the following, we term this pre- 
dicted disordered region "large-a quantum disorered re- 
gion" (large-a QDR). One of the main aims of this paper 
is to investigate if the fact that a quantum-disordered 
phase intervenes in transitions between commensurate 
and incommensurate order is a more general feature of 
frustrated quantum antiferromagnets. 

Similar behavior has been found in a variety of quan- 
tum spin models, including J\ J3-models on the square 
lattice [221 [26-37J, and frustrated honeycomb models 
with Heisenberg [38-40 J or XY interactions [41]. In fact, 
since quantum phase transitions are driven by quantum 
fluctuations, one might expect that - if anywhere - a 
complete restructuring of the ground state in favour of 
a quantum mechanical configuration may occur prefer- 
ably close to a quantum critical point. It, hence, seems 
plausible that at such points quantum fluctuations are 
most effective in disrupting classical order. Indeed, a 
similar effect occurs in classical statistical physics. As- 
sume that there is a transition between a commensurate 
and an incommensurate phase which both show LRO. 
As a first notable thing, close to this transition the ther- 
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Figure 3: The MSWT quantum phase diagram of the 

SATL (from Ref. |17| ) contains Neel order (which is consid- 
erably more stable than in the classical model), spiral order 
(which is destabilized by quantum fluctuations), and two pu- 
tative spin- liquid (SL) phases. These are found through the 
breakdown of the theory and a disappearing spin stiffness, 
which indicates a gapped disordered phase. In the purely ID 
limit, MSWT recovers convergence and produces the ID crit- 
ical state. We include sketches of classical states, where blue 
arrows indicate the directions of the classical rotors, namely, 
the ID state at t'/t = 0, the spiral state at t'/t = 1, and the 
2D-Neel state at a > 2, . 



mal phase transition to a disordered state will typically 
happen at lower temperature than far away from it. Be- 
yond the thermal phase transition, the disordered phase 
will show short-range order of the type corresponding to 
the adjacent long-range ordered phase. The transition 
between the two different kinds of short-range order is 
called a disorder point [^Hi5] . Interestingly, the correla- 
tion length associated with the two kinds of short-range 
order has a minimum just at this point. Hence - simi- 
lar to what is found in the quantum models - thermal 
fluctuations tend to suppress order most effectively at a 
commensurate-incommensurate transition . 

At the low-a side of the spiral phase, Ref. [15] pre- 
dicts a gapped disordered phase for as large a as ~ 0.6, 
followed by a gapless disordered phase in the region 
< a < 0.4. In the following, we term this predicted 
disordered region "small-a QDR." Similarly, MSWT com- 
putations indicate a quantum disordered phase [17] be- 
low a « 0.18, but the very small spin stiffness at al- 
ready a « 0.35 suggests that taking quantum fluctua- 
tions into account more completely than within MSWT 
could destabilize the weak magnetic order already at 
larger a. 



II. QUANTUM-MECHANICAL PHASE 
DIAGRAM 



From the discussion of the classical phase diagram and 
the limiting cases, we have the necessary background to 
tackle the quantum-mechanical ground-state phase dia- 
gram of the XY SCATL. We compute it using MSWT 
supplemented with ordering-vector optimization, work- 
ing directly in the thermodynamic limit. Since this 
method is described in detail in our previous papers 
fT7| [22] . we delegate the technical aspects to the Ap- 



pendix, and only summarize here the main idea. The 
starting point is a classical state, which one dresses with 
quantum fluctuations in a second-order spin- wave expan- 
sion. This yields a bosonic Hamiltonian, the ground 
state of which is found self-consistently by minimizing its 
mean- field free energy. For this, quartic terms, i.e., in- 
teractions between spin waves, are decoupled via Wick's 
theorem. Additionally, we employ Takahashi's modifica- 
tion of vanishing magnetization. This constricts the aver- 
age number of spin- wave excitations to a physical value, 
in contrast to conventional spin-wave theory, where the 
spin- wave excitations grow completely unchecked. This 
modification has proven a crucial improvement to de- 
scribe low-dimensional systems with weak order tenden- 
cies. 

Typically, one uses the classical ground state as the 
reference state. However, in many models quantum fluc- 
tuations considerably shift the type of predominant or- 
der. Therefore, we find the ordering vector giving the 
best classical reference state by including it in the self- 
consistent optimization. This has proven crucial to cap- 
ture, e.g., the stabilization of the Neel phase by quan- 
tum fluctuations. As has been proposed in Refs. p~7j[22], 
the breakdown of the theory strongly suggests that at 
mean-field level no semi-classical reference state yields a 
good description of the quantum ground state. This is 
then interpreted as an indication of quantum-disordered 
behavior in the true ground state. This will be an impor- 
tant aspect for the interpretation of the quantum phase 
diagram. 

We compare these results to exact diagonalization 
(ED) of a 15-site lattice, as depicted in Fig.[l] The geom- 
etry is chosen for its symmetry between t, t', t" bonds. 
It is important to leave the boundaries open to allow for 
incommensurate ordering vectors. 



A. MSWT and ED results — ordering vector and 
order parameter 

In this section, we give a first overview over the phase 
diagram, as obtained from the ordering vector Q and the 
order parameter M, followed in the next two sections by 
more detailed analyses. In MSWT, ordering vector and 
order parameter are direc t resu lts of the optimization 
[see Appendix, Eqs. (All) and (A8)]. In ED, they can 
be extracted from the static structure factor, 



S(k) 



1 



(S*S* + SfS 1 ]) 



(4) 



Its peak lies at the o rdering v ector Q ED , and the square 
root of its height, ^S(Q EB ) = M ED , approaches in the 
thermodynamic limit the order parameter M. 

As seen in the MSWT and ED ordering vectors, pre- 
sented in Fig. [4j quantum fluctuations stabilize the Neel 
phases compared to the classical case, as already observed 
in the SATL (Sec. IB). In the central region around 
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Figure 4: Quantum- mechanical phase diagram of the 
SCATL, ordering vector. Upper row: MSWT data. 

Quantum fluctuations stabilize the Neel phase. Around t' ~ 
t" « t, a part of the classical spiral phase survives quantum 
fluctuations (labels in the upper left panel). Lower row: ED 
data for N — 15 sites. Already for this small system, it can 
be appreciated that the Neel phase grows at the expense of 
spiral order (compared to the classical case) . 




Figure 5: Quantum- mechanical phase diagram, or- 
der parameter. ED results qualitatively confirm MSWT. 
In particular, the order parameter for both methods decreases 
rapidly upon approaching the MSWT breakdown regions. 

t' « t" « t, a broad range of incommensurate order- 
ing vectors indicates spiral order. The finite MSWT or- 
der parameter (Fig. [5j left panel) shows that in these 
phases indeed LRO survives quantum fluctuations. (Note 
that the self-consistent MSWT calculations become rela- 
tively unstable for small order parameters, which results 
in ragged phase boundaries.) 

In the Neel phases, the ED order parameter (Fig. |5j 



right panel) is maximal, giving support to the assumption 
that here LRO persists. However, it is much smaller in 
the spiral phase than the MSWT value, a discrepancy 
already found in the SATL |17| . (This could be due to 
corrections to the third-order spin- wave expansion which 
our approach neglects, and which can become important 
in spiral configurations |46j.) 

Between the ordered phases, we find a broad region 
where MSWT breaks down, indicating as usual [171 H2] 
that these regions do not allow a description in terms 
of an ordered, semi-classical state. Therefore, it ap- 
pears that it is a quite universal feature of frustrated 
quantum antiferromagnets that spiral- and collinearly- 
ordered phases are always separated by quantum disor- 
dered phases. This finding constitutes the main result of 
this paper. 

The strong decrease of the MSWT and ED order pa- 
rameters (Fig. [5]) upon approaching this region gives sup- 
port to this interpretation (which we will further corrobo- 
rate in the next two sections). Note also that both the ED 
and MSWT order parameter seem to disappear relatively 
smoothly when approaching the putative ID-like QDR 
(consider, e.g., in the range 2 < t'/t < 3, t" jt — >• l - ). 
Upon approaching the putative large-a QDR dividing 
spiral from Neel LRO, on the other hand, for ED, the 
order parameter decreases more sharply (consider, e.g., 
the line t'/t = 1, t" jt Here, for MSWT, the 

breakdown occurs abruptly at finite order parameters. 
This points at a difference in the type of phase transi- 
tion upon approaching the large-a QDR and the non- 
magnetic region at the decoupled-chains limit. 

The rest of this article is devoted to fleshing out our 
main finding, the appearance of a disordered region en- 
circling the spiral phase. 

B. Supporting observables from MSWT — spin 
stiffness and spin-wave velocities 

In Refs. [T71 [22]. the spin-stiffness tensor, which char- 
acterizes the stiffness of the magnetic order under change 
of the ordering vector, has proven a valuable consistency 
check of our MSWT calculations. Its components are 

pa ' p ~ dQ a dQ? ' (5j 

where T is the free energy. Even if the order parameter 
is finite, a small spin stiffness suggests that further quan- 
tum fluctuations than taken into account within MSWT 
could disrupt the remaining order [54J. 

Since for our purposes an upper bound for the spin 
stiffness is sufficient, we take the partial derivative in 
Eq. ([5]). The exact spin stiffness can be computed via 
the total derivative. To this, within the self-consistent 
MSWT calculations, one first has to find the optimal 
ordering vector. Then, one reruns the self-consistent 
MSWT equations for several fixed, slightly non-optimal 
ordering vectors, yielding slightly larger energies. The 
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Figure 6: Upper panel: The partial spin stiffness 

decreases upon approaching the MSWT breakdown region, 
suggesting the disruption of magnetic LRO. Lower panels: 
The spin- wave velocities perpendicular to the dominating 
coupling strength soften in the ID limits. Differences in the 
spin-wave velocities might allow to measure the anisotropy of 
the SCATL. All quantities are normalized to 1 + t' + t" . 



spin stiffness can be derived by fitting a quadratic form 
to the resulting energy landscape. In the self-consistent 
iteration, the mean fields characterizing the MSWT state 
can adjust to a changed ordering vector. This effect is not 
taken into account in the partial derivative, which hence 
provides an upper bound to the total spin stiffness. We 
find that it suffices to extract the location of disordered 
phases, but it may yield wrong results about their nature. 
In particular, we found in the SATL [17] that, upon ap- 
proaching the putative small-a QDR, not only the total 
inter-chain, but also the total intra-chain spin stiffness 
decreases strongly. Since such a behavior is not consis- 
tent with algebraic correlations along the chains, this can 
be interpreted as an indication of a gapped QDR. The 
partial spin stiffness computed in Ref. [17J, on the other 
hand, only vanishes in the inter-chain direction. Hence, it 
may not be able to distinguish gapped from gapless spin 
liquids. However, it still seems to adequately capture the 
location of disordered regions. 

In Fig.© upper panel, we show the determinant of the 
spin-stiffness tensor, det(p), normalized to the coupling 
strengths \+t' +t" . As we should expect [47], it decreases 
upon approaching the phase transitions, especially from 
the Neel-ordered side. At large t' (£"), this decrease is 
due to a softening of the stiffness in x (y) direction, and 



at small (t'/t,t"/t) in the direction perpendicular to t\ 
(as has also been found in Ref. [17J). 

Another indicator for approaching disordered phases 
is given by the spin- wave velocities v Xi y, which can be 
connected to the spin stiffness via the susceptibility [48] . 
Since the spin-wave velocities are defined as the leading 
order of an expansion of the spin-wave dispersion rela- 
tion, Eq. (A7), around small |fe|, i.e., 



v x lim LJk/k x 
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they can be measured directly from the spin- wave disper- 
sion, allowing an experimental check of our findings. 

As seen in Fig. [6| lower panels, close to the ID break- 
down region, they, too, soften in the direction perpen- 
dicular to the dominating coupling. On the other hand, 
when approaching the putative large-a QDR dividing the 
spiral from the Neel phase, both spin-wave velocities re- 
main finite. This suggests that the large-a QDR could 
be qualitatively different from the non-magnetic phase 
found in the limit of decoupled chains. 



Supporting observables from ED — energy 
derivative, gap, and chiral correlations 



The ED observables investigated in Sec. |IIA| allowed to 
interpret the predominant ordering behavior, but did not 
yield clear evidence if within ED really quantum phase 
transitions exist, and if yes, where. The second derivative 
of the ED ground-state energy, which we plot in Fig. [7| 
can provide such an indicator, as in the thermodynamic 
limit it diverges at a quantum phase transition. 

Indeed, there are clear peaks along lines similar to 
where in MSWT the Neel order breaks down. Also, a 
peak appears around (t',t") = (1,1). This might be 
interpreted as the precursor of a quantum phase tran- 
sition away from the spiral state, and possibly to the 
non-magnetic phase which is supposed to exist in this 
system. 

We get further support for this phase diagram from 
the ED energy gap per spin between ground and first 
excited state, Fig. [8] In the well-known limiting cases 
of the SCATL, it behaves as expected: There is no sin- 
glet gap close to the decoupled-chains limits, since the 
system is then in a critical phase. In the Neel ordered 
phases, there is a large gap which separates the ground 
state from closely-spaced excitations, which in larger lat- 
tices become the spin waves, collapsing slowly towards 
the ground state [49]. This is consistent with the consid- 
erable size dependence found in our calculations for that 
parameter region, as can be seen in the right panels of 
Fig. [8j where we plot cuts of AE EB at fixed t" /t = 1, 2, 3 
for triangular systems similar to the one in Fig. [T] with 
TV = 6, 10, 15. 
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Figure 7: Second derivative of ED ground-state en- 
ergy per spin for the N = 15 system. For clarity, we plot the 
logarithm after a shift to values larger one, L(d 2 E BD /dt l2 ), 
where L(x) = log(l + max(x) — x) and where t 1 is t' or t" . 
Strong peaks clearly mark the phase transitions from the Neel 
phases. An additional peak around (£',£") = (1,1) might 
be an indication of an additional phase, separating the Neel 
phases from the spiral one. 




Figure 8: Left panel: The singlet gap from ED gives 
support to the MSWT phase diagram: A finite gap sepa- 
rates in the Neel phases spin- wave excitations from the ground 
state. In the spiral phase, the ground state is doubly degener- 
ate due to the ambiguity in choice of chirality. The finite gap 
surrounding the degenerate region could be a precursor of a 
gapped, disordered phase. At the quantum phase transitions 
to the Neel phases, the gap closes again. Right panels: 
cuts at fixed t" /t = 1,2,3 for triangles with increasing N 
(from light to dark and thick to thin: 6,10,15). There is little 
size dependence in the central gapped phase (t" — 2, 3£ with 
t' « £, as well as t" = £ and £' /£ > 1.5). 



On the contrary, there is no gap in the spiral phase, 
because there are two degenerate ground states with op- 
posite chirality [55]. We find that the vanishing of the gap 
depends strongly on the system geometry, but it occurs 
consistently for all triangular systems considered. 

Interestingly, the gapless spiral phase is surrounded by 
a region where the gap attains considerable values. The 



very small dependence on system size for this parameter 
region indicates that this is stable towards the thermody- 
namic limit. A finite gap is not consistent with a spiral- 
ordered phase. On the other hand, the predominant 
order in this region is at incommensurate wave- vectors. 
Hence, the finite gap is clearly not due to square-lattice 
Neel physics. Optimistically, these findings could there- 
fore be interpreted as the precursors of a gapped non- 
magnetic phase phase. This gapped region completely 
encircles the spiral phase, suggesting that the low- and 
large-a gapped QDRs found in the SATL could actually 
be continuously connected via the additional anisotropy 
of the SCATL. 

The gap closes again upon approaching the Neel 
phases, indicating a quantum phase transition. 

To understand better the nature of this possible 
gapped, non-magnetic region, we now study the persis- 
tence of chiral correlations. The vector chirality is defined 
as 

2 

K>i,j,k ~ <^^J7^ X ^3 ^3 X X z ' 

where the sites {i,j,k} are located counter-clockwise on 
a triangle. For the small systems used in our ED, we 
generalize the chiral correlations [50J to 

*- = J^(52scKc^S a K a ) . (8) 

c a 

Here, the sum a runs over all triangles, while c runs only 
over the central ones to reduce boundary effects. The 
factors s ayC weight n a ^ c with a + (— ) sign if the triangle 
points upwards (downwards). The prefactor, where TVa 
is the number of summands, is chosen such that the chiral 
correlation has the same theoretical maximum of | as the 
usual definition for large lattices [50J. 

As can be seen from the ED results of the N = 15 
lattice (Fig. |9j left panel), the chiral correlations are rel- 
atively small in the Neel phases and large in the spiral 
phase around (£'/£, t" /t) = (1,1). However, at this lat- 
tice size, there are still appreciable chiral correlations in 
the rest of the parameter regime. In particular, in the 
ID limit, the chiral correlations are only a little smaller 
than in the spiral phase. Therefore, we also plot in 
Fig. [9j right panel, an extrapolation to large lattices by 
^_(7V) = ^_(7V = oo ) + + §2, where we use the 
known form for the leading finite-size behavior [25] but 
also include the first subleading correction due to the 
small systems under consideration (our data comes from 
lattices with TV = 7, 10, 12, 15, 18, all chosen to have the 
same number of t, t' : and t" bonds, as sketched at the 
bottom of Fig. [9J. From this it seems that the chiral 
correlations disappear only in the decoupled chains lim- 
its. Contrary to the equivalent model with Heisenberg 
interactions [23] , chiral LRO seems to not only survive in 
the central region around (t f /t,t ff /t) = (1, 1), but also in 
part of the presumably gapped and non-magnetic region, 
extending all the way to the Neel phases. A finite gap 
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N=12 



7V=18 



N=7 



Figure 9: Chiral correlations from ED. Upper left: 

Already for small systems (N = 15), the chiral correlations 
are appreciably smaller in the Neel phases than in the rest 
of the phase diagram. Upper right: From an extrapolation 
to large lattices, it appears that chiral LRO only survives 
in a small central region around (t f /t,t"/t) = (1, 1), lending 
support to the appearance of an extended disordered phase. 
Below: The geometries used in the extrapolation are chosen 
for symmetry upon rotation by 60° and equal number of t, 
and t" bonds. 



coexisting with long-range chirality would indeed consti- 
tute an intriguing instance of a non-magnetic many-body 
ground state. 



D. MSWT predictions for time-of-flight pictures 

Finally, we wish to connect our predictions to experi- 
ment. A well-established experimental technique for ul- 
tracold atoms is time-of-flight (ToF) imaging of the atom 
momentum distribution, 



n b (fe) 



ik-(r 



(b\bj) • 



(9) 



Since the bosons of Hamiltonian ([I]) have U — >• oo, this 
is equivalent to measuring the magnetic structure factor 
S (fe), for the XY spins of Hamiltonian see Eq. Q. 
Figure 10 presents ED predictions (for N = 15) for 



ToF images at various values of anisotropy. The upper- 
most row shows parameter values from the SATL. The 
other rows show from top to bottom results for increas- 
ing additional anisotropics in steps of 10%. The black 
lines denote the first Brillouin zone (1st BZ). Commen- 
surate 120° spiral order has peaks at the corners of the 
1st BZ (as in the first panel of the second row), while 
peaks at the center of two opposing sides of the 1st BZ 



mark Neel order (as in the lower two panels of the sec- 
ond row). Incommensurate spiral order is characterized 
by peaks lying between these two limiting cases (as in the 
second panel of the second row). Close to the ID limit, 
the peaks decrease in magnitude and smear out strongly 
along a straight line (as seen in the first panel of the first 
row). In large systems, disordered phases are character- 
ized by a sub-extensive growth of the peak height. 

As seen in the ToF pictures in Fig. [TUJ the additional 
anisotropy can clearly shift the system from one phase to 
a qualitatively different one. For example, the momen- 
tum distributions in the first row pass from an almost 
ID-like spiral state to an adjacent Neel phase. Similar 
behavior is found for other values of (t'/t,t"/i). Such 
ToF pictures, therefore, would allow to observe the influ- 
ence of the additional anisotropy in experiment. 



III. CONCLUSION 

In conclusion, we have provided a thorough analy- 
sis of the ground-state phase diagram of the quantum 
XY SCATL. Using various observables from modified 
spin-wave theory supplemented with ordering- vector op- 
timization, and supported by exact diagonalization data, 
we have found that quantum fluctuations stabilize Neel 
order with respect to the classical phase diagram. Fur- 
ther, they reduce the extent of the spiral phase, which 
seems to be entirely surrounded by a quantum disordered 
region. This result, which constitutes our main finding, 
is supported by the breakdown of MSWT, together with 
the strong decrease of the order parameter and the spin 
stiffness. While MSWT cannot be applied to studying 
this region, the fact that no semiclassical reference state 
describable by an ordering vector yields a stable solution 
is highly suggestive of a magnetically-disordered phase of 
purely quantum origin. Hence, our results outline a very 
promising candidate region for such exotic states, merit- 
ing further research with more sophisticated theoretical 
methods or experimental setups. 

The possible existence of quantum-disordered phases 
is further corroborated by ED data, where a finite gap 
makes magnetic LRO seem unlikely. Also, the strong de- 
crease of the ED structure-factor peak appears to support 
this interpretation. For part of the possibly gapped re- 
gion, ED suggests the persistence of chiral LRO, contrary 
to the equivalent model with Heisenberg interactions [23J . 
The possibility of a gapped chiral phase in this part of the 
phase diagram would be an intriguing subject for further 
research. 

A complete encircling of the spiral phase by disordered 
phases could naturally explain the succession of a gapped 
and a gapless non-magnetic phase at the \ow-a limit of 
the SATL. The gapless non-magnetic region would be 
continuously connected to the limit of decoupled chains, 
while the additional anisotropy of the SCATL would 
adiabatically connect the gapped quantum-disordered 
phases at small and large a. Therefore, the additional 
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Figure 10: ToF predictions (corresponding to the static structure factor) allow comparison to typical experimental results. 
The additional anisotropy of the SCATL increases from top to bottom in steps of 10%, showing that it can shift the system to 
phases with different qualitative order. 



anisotropy has great potential to deliver new insights into 
the nature of these phases. From an experimental point 
of view, the persistence of the non-magnetic phase under 
the additional anisotropy suggests that it can also be ob- 
served under slightly imperfect driving (i.e., if it is not 
completely symmetric under exchange of two bonds). 

Finally, we provided MSWT predictions for the boson 
momentum distribution in time-of- flight pictures, a 
comparison to which might allow to probe the additional 
anisotropy in upcoming experiments, e.g., with ultracold 
atoms in optical lattices. 
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Appendix A: MSWT formalism 

In this Appendix, we shortly review MSWT for XY 
antiferromagnets; for a full description, see [17J. 

A fundamental assumption of spin- wave theory is that 
the ground state has LRO with ordering vector Q. Hence, 
it is convenient to rotate the local reference system as 

S* = -sin(Q-r i )^ + cos(Q-r i )^ C , (Ala) 
S? = cos(Q-r i )^ + sin(Q-r i )^ C , (Alb) 
Sf = -S*. (Ale) 

Then s£ , which will be the quantization axis, lies parallel 
to the classical spin Si = (cos (Q • ri) , sin (Q • ri) , 0). 
This defines the classical reference state. We do not make 
any assumption on the ordering vector Q. In particular, 
it may well differ from the one of the classical limit (Q cl ). 

Spin waves around this reference state can be described 
by the Dyson-Maleev (DM) transformation [5T| [52] . 
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which maps the physical spins to interacting bosons, 



= ( 2S ~ 4 a i) a i 



S + -> V2Sa\, 
Sf ->• -S + a\di, 



where = Sf ± These bosons describe quan- 

tum fluctuations around the spin reference state, and are 
(A2a) no * ^° ^ e conmse d with the original bosons appearing in 
Hamiltonian Q. 

(A2b) 
(A2c) 



This transformation maps the Hamiltonian, Eq. (|2|, to the non-linear bosonic Hamiltonian 

1 



T-L — S 2 ^2 Uj 



^ (2a\ai + 2a t a 3 - - a\a 3 - - a»at + a t a] + 



cos(Q • r*j) . 



(A3) 



where a$ (aj) destroys (creates) a DM boson at site z, 
and £ is the length of the spin. Here, we neglected 
the kinematic constraint which restricts the DM-boson 
density n to the physical subspace n < 2S. Moreover, 
we dropped terms with six boson operators, which are 
of order 0[n/(2S) 3 ] and are negligible for n/(2S) < 1. 
Using Wick's theorem [53], and defining the correlators 
(a\a 3 ) = F(rij) - \5 i3 and (a^j) = (ajaj) = G{r i3 ), 
the expectation value E = (T-L) can be written as 



E 




(A4) 



cos (Q • 

7n a * 



-ik-Vi 



After Fourier transforming, a& = 
and a subsequent Bogoliubov transformation, a k 
cosh 6 k a k — s'mh 6 k a^_ k , and a*_ k = — sinn^a*, + 

cosh(9fca^ fc , we minimize the free energy T under 
the constraint of vanishing magnetization at each site, 
(a\ai) = S, which is known as Takahashi's modification 
[21J. This yields a set of self-consistent equations, 

h (A5) 



tanh 20 k 



B k 



with 



-- J2 Us cos (Q-r^Gij e ik ri 



(A6a) 



N ^ 



{tij cos (Q • rij) 



X 



[G y + ^-(l-e ifc - r «)]}-A*(A6b) 

where \i is the Lagrange multiplier for Takahashi's con- 
straint. The spin- wave spectrum reads 



u k = yBl-Al. (A7) 
At T = 0, fi vanishes, which implies the disappearance of 
the gap at k = that may exist for finite temperature. 



This is a necessary condition for magnetic LRO, and en- 
ables Bose condensation in the k = mode. Separating 
out its contribution, 



( a k =o a k=o) l N = («fc=o«fc=o) /N = M , 



(A8) 



which corresponds to the magnetic order parameter, one 
arrives at the zero-temperature equations 



Gin 



M 



M 



1 



Bk 



2N ^ uo k 

fc#0 



7N ^ 



2N ^ ou k 

k^O fc 



COS (fe • Vi 



cos (k • r i3 ) , 



(A9a) 
(A9b) 



and the constraint of vanishing magnetization at each 
site becomes 



M 



1 



Bk 



2N ^ uj k ' 



(A10) 



It is not a priori clear that the classical ordering vector 
qcI correctly describes the LRO in the quantum system. 
To account for a competition between LRO at different 
ordering vectors Q, we extend the MSWT procedure by 
optimizing the free energy T with respect to the ordering 
vector Q. This yields two additional equations which 
must be added to the set of self-consistent equations, 



d 



G 



(ho) 



= 0, 
(Alia) 

= 0. 
(Allb) 

The values of Fi 3 and Gij can now be calculated by 
solving self-consistent ly Eqs. (A6--A11). Through Wick's 



d 
dQ y 



theorem the knowledge of the quantities F i3 and G{ 3 de- 
termines the expectation value of any observable. 
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